ML Blog - Research notes

Report – Few-Shot Text Classification

Large Language Models

📝 Article: https://few-shot-text-classification.fastforwardlabs.com/ (2020)

Inference Optimization – Lil’Log

Large Language Models

Quantization

📝 Article: https://lilianweng.github.io/posts/2023-01-10-inference-optimization/

Local Large Language Models – Int8

Large Language Models

Quantization

📝 Article: https://int8.io/local-large-language-models-beginners-guide/

LoRA – Low-Rank Adaptation of Large Language Models

Large Language Models

PEFT approach based on matrix factorization.

phi-1 – Textbooks Are All You Need

Large Language Models

It introduces phi-1, a model with 1.3B parameters that obtains a…

Tart – A plug-and-play Transformer module for task-agnostic reasoning

Large Language Models

Tart combines the performance of fine-tuning with the ease-of-use of in-context learning. It is…

Training Data Influence Analysis and Estimation A Survey

Machine Learning

📝 Paper: https://arxiv.org/pdf/2212.04612.pdf